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Abstract. We introduce a conjectural construction for an extension to superspace of the Mac- 
donald polynomials. The construction, which depends on certain orthogonality and triangularity 
relations, is tested for high degrees. We conjecture a simple form for the norm of the Macdonald 
polynomials in superspace, and a rather non-trivial expression for their evaluation. We study 
the limiting cases q = and q = oo, which lead to two families of Hall-Littlewood polynomi- 
als in superspace. We also find that the Macdonald polynomials in superspace evaluated at 
q = t = 0orq = t = oo seem to generalize naturally the Schur functions. In particular, their 
expansion coefficients in the corresponding Hall-Littlewood bases appear to be polynomials in 
t with nonnegative integer coefficients. More strikingly, we formulate a generalization of the 
Macdonald positivity conjecture to superspace: the expansion coefficients of the Macdonald 
superpolynomials expanded into a modified version of the Schur superpolynomial basis (the 
q — t — family) are polynomials in q and t with nonnegative integer coefficients. 



1. Introduction 

The Macdonald polynomials [15] can be denned by: (1) their orthogonality with respect to 
a certain scalar product, depending on two parameters q, t, and (2) their triangular decompo- 
sition in the monomial basis with respect to the dominance ordering. The aim of this work is 
to study the possible extension of the Macdonald polynomials to superspace along this precise 
constructive procedure, namely by enforcing triangularity and orthogonality. In the Jack poly- 
nomial limit (q = t a and t — > 1), we recall that such an extension to superspace was constructed 
in [31 [5]. It is important to note that while in the Jack's case the construction could rely on 
the supersymmetric version of the trigonometric Calogero-Moser-Sutherland model [20|, [2], the 
super symmetric version of the Macdonald operators and the Ruijsenaars-Schneider Hamiltonian 
are still elusive. 

We introduce in Section 2 some preliminary results concerning the Macdonald polynomials 
and formulate the strategy to be followed in order to investigate their generalization without the 
support of an eigenvalue problem. The notion of superspace and the relevant properties of the 
corresponding extension of the Jack polynomials are briefly reviewed in Section 3. The stage is 
then prepared for the exploratory investigation of the Macdonald polynomials in superspace (also 
called Macdonald superpolynomials) presented in Section 4: a previously conjectured form of the 
scalar product [5j Conj. 34] is invalidated (no solution to the problem exist), but by introducing 
a slight deformation of this scalar product we end up with a new setup for the construction of 
the Macdonald polynomials in superspace. The correctness of this construction is substantiated 
here by the computation of many non-trivial examples which solve (for high degrees) the over- 
determined systems of equations resulting from the imposed orthogonality and triangularity. 
Moreover, we present in the last subsections many conjectures that provide further evidence of 
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the validity of the construction. In Section 14.31 we give conjectures for the norm, the integral 
version and the evaluation of the Macdonald superpolynomials. In Section [4.41 we study various 
limiting cases of the Macdonald superpolynomials. The limiting cases q = and q = oo, which 
lead to two distinct families of Hall-Littlewood polynomials in superspace, are worth pointing 
out. We also find that the Macdonald polynomials in superspace evaluated at q = t = or 
q = t = oo seem to provide natural generalizations of the Schur functions. In particular, we 
conjecture in Section 14.51 that their expansion coefficients in the corresponding Hall-Littlewood 
bases are polynomials in t with nonnegative integer coefficients. Section 14.51 culminates with 
the most striking result of the article: the extension of the Macdonald positivity conjecture to 
superspace. Concluding observations are made in Section [5j and finally, tables of Macdonald 
superpolynomials and Kostka coefficients are given at the end of the article. 

2. Macdonald polynomials 

A partition A = (Ai, A2, • • •) of degree d is a vector of non- negative integers such that Aj > Aj+i 
for all i and such that Yli = d. The Macdonald polynomials Pa = P\(%] Q,t), in the variables 
x = xi, X2, ■ ■ ■ , xn, are characterized by the two conditions 

1) P\ = m, a + lower terms, 

(2.1) 

2) ((P A |P M )) g)t = if A^/i, 

where N is assumed to be larger than the degree of A. The triangular decomposition is given 
with respect to the usual dominance order on partitions: 

fM < A iff |H = 1^1 an d A*i + • • • + fJ-i < Ai + • • • + Aj Vi, (2-2) 

where |A| stands for the degree of the partition. The monomial functions m\, in which the 
triangular expansion is formulated, are given by 

™a= E'<h--- x l(Ny (2-3) 

where the prime indicates a sum over distinct permutations. Note that we consider in the 
equation that A^+i = • • • = Ajy = if the partition A is of length £ = £(X) (the number of its 
non- zero parts). The orthogonality relation is defined in the power-sum basis 

N 

Px = P\i ' ' ' Px e with p r = ^ x i j (2- 4 ) 

i=i 

by 

TT 1 " 9 Al 

((P\\P»))q,t = Z X S\,f, J| A . , (2.5) 

4 = 1 

where 

z x =l[i n ^n x (i)\, (2.6) 

i>l 

n\(i) is the number of parts in A equal to i. 

The Macdonald polynomials can be constructed, following characterization (|2.ip . using the 
Gram-Schmidt orthogonalization process (choosing any total ordering compatible with the dom- 
inance ordering). We should emphasize that imposing the triangularity with respect to the 
(partial) dominance order diminishes the number of unknowns in the Gram-Schmidt process 
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and thus leads to over-determined systems of equations (see Section 2.1). Therefore, the ques- 
tion of existence needs to be settled separately. The standard procedure is to show that these 
polynomials are eigenfunctions of some operators, the Macdonald operators in the present case. 
The existence of non-trivial solutions to an overdetermined system is often the hallmark of an 
underlying integrable model. This is indeed the case here: the operators are actually related 
to the Ruijsenaars-Schneider Hamiltonian [19] (see also for instance j8j Sect. 1] and [TBI Sect. 
7.6.2]). 

2.1. Exploring generalizations of the Macdonald polynomials: a simple strategy. The 

problem we consider here is to explore the existence of a particular extension of the Macdonald 
polynomials (to be formulated precisely below) in the absence of an underlying differential 
operator with respect to which the sought-after generalized polynomials would be eigenfunctions. 
The previous remark concerning the over-determinate nature of the corresponding system points 
toward a simple exploratory strategy that we now spell out plainly. 

First, we stress that the consistency of the construction of families of polynomials character- 
ized by orthogonality and triangularity is verified separately for each value of the degree of the 
partitions. It is clear that for low values of the degree, where the ordering is total, there will 
always exist a solution: there is an equal number of unknowns and equations. Stated differently 
(cf. \16\ p. 9]), the Gram-Schmidt orthogonalization process ensures a unique solution to the 
conditions (1) in (]2.ip and a weaker form of (2), namely: 

((P\\Pv)) q ,t = if A>m- (2-7) 

However, for the first value n of the degree at which not all partitions of n are comparable in the 
dominance ordering, one encounters an over-determined system. Then, the critical test amounts 
to verify the orthogonality of the polynomials labeled by partitions that cannot be compared. 
The verification of these orthogonality relations provides a strong hint for the existence of these 
polynomials under construction. On the other hand, if it fails, this suffices to prove that the 
characterization by orthogonality and triangularity is not correct. Moreover, one expects this 
failure to show up for pairs of non-comparable partitions of lowest degree. 

Let us illustrate this simple methodology for the ordinary Macdonald polynomials. The 
lowest degree at which the dominance ordering is not total is n = 6. Indeed, two pairs of 
partitions cannot be compared: (3,1,1,1) vs (2,2,2) and (3,3) vs (4,1,1) (cf. Fig. QJa)). Let 
us consider the construction of P(3,i,i,i) and P(2,2, 2)- Denote (3,1,1,1) and (2,2,2) by A^ 1 ) and 
A*- 2 ) respectively. Clearly, we have 

A« > (2,2,1,1) > (2,1,1,1,1) > (1,1,1,1,1,1), i = 1,2. (2.8) 

One thus constructs successively P(i,i,i,i,i,i), f (2,1,1,1,1) > ^(2,2,1,1) > an d then, separately, each 
, which are both of the form: 

P A« = m A« + a l i)m (2,2,l,l) + 4^ m (2,l,l,l,l) + a 3 )m (l, 1,1, 1,1,1)' ( 2 - 9 ) 

with given coefficients (depending on q and t) obtained by imposing: 

pA«|iM»*.t = ° for {(2, 2, 1,1), (2, 1,1, 1,1), (1,1, 1,1, 1,1)}. (2.10) 

The consistency test is to verify the orthogonality relation for the two polynomials labeled by 
non-comparable partitions, namely: 

((Px^\P^))) q ,t = (2.11) 
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which is known to be satisfied in the present case. 



FIGURE 1 . Hasse diagrams of the dominance ordering on partitions of degree 6 and on su- 
perpartitions of degree (4|1). The (super)partitions that can be compared are related by arrows 
pointing towards the lowest (super)partitions. 
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(2,1,1,1,1) (1; 1,1,1) 

t t 

(1,1,1,1,1,1) (0; 1,1, 1,1) 
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3. Symmetric polynomials in superspace 

Superspace refers to a pairing of each coordinate x% with an anticommuting partner where 
Of = 0. A polynomial in superspace (also called a superpolynomial) is a polynomial in the usual 
(commuting) N variables x\, ■ ■ ■ , xjv an d the N Grassmaniann variables 9\, ■ ■ ■ ,0n- It is sa id 
to be symmetric if it remains invariant with respect to the simultaneous interchange of X\ <-> xj 
and Oi O 9j for any i,j [2]. In other words, introducing for any a £ Sjy, 

H, = «,K„ where ( ^ : . . . ,x N ) ^ (x a{1) , . . . X(t{n) ) ^ 

then a polynomial in superspace P(x; 9), with x = (x±, . . . ,xn) and 9 = (9\, . . . , 9jy), is sym- 
metric when 

IC a P(x; 9) = P(x; 9) for all a € S N . (3.2) 

Symmetric superpolynomials are labeled by superpartitions [2]. A superpartition A is a pair of 
partitions (A a ; A s ) = (Ai, . . . , A m ; A m+ i, . . . , Ajv), where A a is a partition with m distinct parts 
(with possibly one of those parts equal to 0), and A s is a (regular) non-increasing partition^ A 



^When m = 0, A = ( ; A) can be thought as the ordinary partition A and the semi-column is omitted. 
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superpartition A of the above form is said to have degree (n\m), written for short as deg(A) = 
(n\m), when £^Aj = n. We refer to m and n respectively as the fermionic degree and total 
degree of A. For example, there are seven superpartitions of degree (3|1): 

(0; 1, 1, 1), (0; 2, 1), (0; 3), (1; 1, 1), (1; 2), (2; 1), (3; ), (3.3) 

and twelve at degree (4|1) (listed in Fig. QJb)). 

To every superpartition A we can associate a unique partition A* obtained by deleting the 
semicolon and reordering the parts in non-increasing order. A diagrammatic representation of 
A is given by the Ferrers diagram of A* with circles added at the end of every part of A a , and 
ordered in length as if a circle was a half-box. Finally, we denote by A® the partition whose 
Ferrers diagram is obtained from that of A by replacing circles by boxes. For instance, we have: 



A = (3, 1,0; 5, 4, 3) : 



A* : 



A" 



• (3-4) 



Notice that both A* and A® are ordinary partitions, of respective degree n and n + m, if 
deg(A) = (n\m). 

The natural extension of the usual dominance ordering to superpartitions is the following [6] : 

n < A iff deg(A) = deg(O), fi* < A* and Q® < A®. (3.5) 

We stress that two pairs of ordinary partitions, f2* vs A* and O® vs A®, are compared with 
respect to the usual dominance ordering (|2.2p . The lowest degree at which this ordering is not 
total is (4|1) (see Fig. Hfb)). I n that case, two pairs of superpartitions cannot be compared: 
(2; 1, 1) vs (0; 2, 2) and (2; 2) vs (0; 3, 1). For instance, for the first pair, we have: 

A = (2; 1,1), A* = (2, 1,1), A® = (3, 1,1), 

ft = (0; 2,2), 0* = (2,2,0), O® = (2,2,1) 

so that 

A* < fT but A® > o®. 



(3.6) 
(3.7) 



We now introduce the two relevant classical bases of symmetric polynomials in superspace 
[3]. The first one is the extension of the monomial polynomials defined as 



m A (x;i 



N 



(3.8) 



where the sum is over distinct permutations. The other one is the generalization of the power- 
sum symmetric functions 



PA = PAi PA m PA m+1 ■■■PAt, 



where pk 



and 



Pi 



(3.9) 



where k > and £ > 1. 

We conclude this review section by recalling the definition of the precise objects we want to 
deform, the Jack superpolynomials. We denote them as Pa = P^*\x, 9); they are characterized 
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by the two conditions [5]: 

1) Pa = m A + lower terms, 

(3.10) 

2) ((P A \Pn))a = if A^Q, 
where the scalar product is defined as 

«PA|Pn» Q = (-!)(") «' (A) za-Sav (3-11) 

with z\s defined in (12.6(1 and £(A) = m + £(A s ) = £(A®). The existence of such a basis is proved 
in [5] using the super symmetric extension of the Calogero-Moser-Sutherland model. 

4. The quest for Macdonald polynomials in superspace 

We are now in position to explore the existence of the superspace extension of the Macdonald 
polynomials obtained by a suitable generalization of the construction reviewed previously for 
the limiting cases of the ordinary Macdonald polynomials and the Jack superpolynomials. 

4.1. Invalidation of the original conjecture. We first consider the conjecture in [5j Conj. 
34] formulated in terms of the conditions ()3.10j) and the dominance ordering ()3.5[) , but with the 
scalar product (]3.1ip replaced by the following natural (q, t) deformation^] 

((PAbn»^ = (-l)^^A(g,t)<5A,n, (4.1) 

where 

<(A) _ A ® 

* A (?,t)=*A.n — V- ( 4 - 2 ) 
i=1 i-t * 

This reduces to (|3.1ip when q = t a and t — > 1. The rationale motivating this precise form of the 
conjectured scalar product is rooted in the naturality of the generalized form of the reproducing 
kernel: 

n 'St^ -D-'ftM-'wMwM, (4.3) 

where (a;q)oc = Y\ n>0 (l — aq n ) (for the details of this correspondence, in particular, the way 
Z\{q, t) is read off this relation, we refer to a similar analysis in [U Theo. 33]). Indeed, for all the 
cases studied previously, namely the classical symmetric functions [4j and the Jack polynomials 
[5], the superspace extension of the kernel is obtained by simply replacing Xijjj by x^y^ + O^j. 

As explained in Section 12.11 displaying a single counter-example suffices to invalidate the 
conjecture. And the simplest such counter-example is expected to arise at the lowest degree 
(n\m) where the ordering is not total, which is (4|1). This is indeed so: the scalar product of 
P(2;i,i) and -P(0;2,2)> polynomials whose labeling superpartitions are not comparable (cf. (|3.6p - 
(|3.7p ). is found to be non-zeroJl 



2 The conjecture was originally presented with respect to the ordering [4[ Corr. 7]: 



<' A iff deg(A) = deg(fi) and 



Q* < A* or 

£T=A* and Q® < A®. 



The ordering <' leads to less over-determined systems of equations in our construction than the ordering < given 
that more pairs are comparable in the ordering <' than in the ordering <. Nevertheless we have verified that the 
conjecture also fails using the ordering < (this time at degree (6|1)). 

^It vanishes only in the Jack superpolynomial limit q = t a and t — > 1 and for q — t. 
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4.2. A new conjecture. Although (|4.ip is natural, the correctness of the Jack-limiting behavior 
is not fully constraining. Actually, there is a whole family of acceptable deformations of (|3.1ip . 
In particular, the form (13. llf) depends rather weakly upon the parts in A a : it only depends upon 

their number m via the factor (— l)^ 2 ^a m . This suggests to investigate the following simple 
deformation of z\ which amounts to replace the portion of the product depending upon A a by 



771 



1 „Aj+l m i „Ai+l 

i=l i=l 

where r is a parameter depending on q and t that needs to be determined. This form can be 
obtained from the generalized kernel : 

-U. { T Vi I IT (faa8i <«> 

which reduces to (|4.3j) when r = t. Call the corresponding r-dependent scalar product (( | 
To fix r, we again consider the lowest degree where the dominance ordering is not total, namely 
(4|1). As already stressed, at this degree two pairs of superpartitions are non-comparable: 
(2; 1,1) vs (0;2, 2) and (2; 2) vs (0;3, 1). By enforcing the orthogonality of f(2;i,i) an d -P(o ; 2,2): 
one gets: 

«-P(2;l,l)l-P(0;2,2)»£2 = T = q' 1 

As a non-trivial compatibility check, we verify that -P(2 ; 2) an d -P(o;3,i) are 8 ^ so orthogonal for this 
choice of r. 

With r = the kernel (|4.5p simplifies drastically as an infinite number of factors cancel. 
It reduces to: 

The combination g — Xjt/j in (|4.6p is not natural: g usually appears as a scaling factor of the 
variables. This can easily be cured by rescaling the anticommuting variable 9i by a factor —q. 
This modification does not affect the resulting Macdonald polynomials since all their components 
are multiplied by the same number of anticommuting variables (this alteration only changes their 
norm). The effect of the replacement 6i — > —qOi in the kernel is to transform it into 

*<»™ - n ( 1+T ^y » - «™>n (htz&s) • <«> 

where Ko(x;y) is the kernel in the absence of anticommuting variables. (The last expression is 
to be compared with eq. (5.14)] in the Jack case.) With 

K(x,6;y,<j>) = ZA&ty 1 PA (x,0) PA (y, <f>), (4.8) 

A 

our new scalar product reads: 



)q,t 

where 

^( As ) , A? 



((PA\pn)) q ,t = *A(<Z,t)<*A,n, (4-9) 

^(A s ) 1 _ A? 

z A (q,t) = z A , q^ Yl (4.10) 



i=l 
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indeed, a rather simple form. We note however that this does not precisely reduces to the 
expression ((p A \pn ))a written in (|3.11j) . but rather to oT m ((p\ \pn )) a . However, such a mod- 
ification does not affect the resulting Jack superpolynomials since only polynomials with the 
same fermionic degree m are compared. 

It is thus natural to conjecture the existence of a superspace generalization of the Macdonald 
polynomials, written Pa = Ph{x,9;q,t), as follows: 

Conjecture 1. For each superpartition A there is a unique symmetric superpolynomial P\ such 
that: 

1) Pa = m A + lower terms, 

(4.11) 

2) ((PA\Pn)) q ,t = if A^O. 

where lower terms are considered with respect to the ordering \3. 5\) and the scalar product is 
defined in an< ^ 

This conjecture has been heavily tested. The cases that have been checked are listed in 
Table [H Examples of Macdonald polynomials in superspace are presented in Table [21 

Table 1. The different degrees that have been tested at which the system is over-determined. 



degree (n|m) 


(4|1) 


(5|2) 


(5|1) 


(6]3) 


(6|2) 


(611) 


(713) 


(8|3) 


(9]4) 


# equations 


66 


136 


171 


45 


378 


435 


171 


528 


45 


# unknowns 


64 


128 


163 


43 


351 


401 


163 


482 


43 



From the examples in Table [21 we observe that a property of the Macdonald polynomials 
that does not hold in superspace is the invariance with respect to (q, t) h-> (q , t -1 )- in general, 
whenever m > we have that 

P A (x, 9; q, t) ± P A (x, 6- q-\ t~ l ) (4.12) 

(cf. |15j property VI (4.14)-(iv) for m = 0). This is already manifest from the simplest displayed 
case P(i;o)- I n f ac t, if we set P\{x,9\q,t) = P\(x,9; q^ 1 ,t _1 ), then Conjecture [1] is equivalent 
to saying that P\(x,9;q,t) is the unique polynomial satisfying 1) and 2), but with the scalar 
product replaced by 

{{PA\Pn))' q ,t = (~^ 2 ^ z A (q,t)6 A ,n, where z A (q, t) = z A s t^ A ^ J| . (4.13) 

i=i L 1 1 

As will be explained below, this new scalar product is more convenient in certain circumstances 
since it allows to take the limit q — > 0. 

4.3. The norm, the integral version and the specialization. For a box s = (i,j) € A (i.e., 
in row i and column j), introduce the following arm-lengths and leg-lengths: 

a(s) = A*-j, a(s) = A® — j, 

l(s) = (A*)' j -i, f( S ) = (A»)'.-i, (4.14) 
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where (A*)' and (A®)' stand for the conjugate of the partitions A* and A® respectively. We now 
define 

WA(q,t)= J] (l-^W+V'W), (4.15) 

seB(A) 

where B(A) denotes the set of boxes in the diagram of A that do not appear at the same time in 
a row containing a circle and in a column containing a circle (this excludes for instance the boxes 
(3, 1), (3, 2) and (5, 1) of A whose diagram is found in (|3,4p ). These are the required ingredients 
for formulating our conjecture for the norm expression. 

Conjecture 2. Let P A be the superpolynomial of Conjecture^ and its norm be defined by 

\\P A f = (-lp)((P A \P A )) q>t . (4.16) 

Then, the norm is given by 

|P A f = g iM^ = g |Ai rr 1 - ( 4i7) 

s£0(A) 

where A' is the conjugate of A (the superpartition whose diagram is obtained by interchanging 
the rows and the columns in the diagram of A). 

This expression for the combinatorial norm generalizes naturally both that of the Macdonald 
polynomials [I5j Eq. (VI. 6. 19)] and that of the Jack super polynomials established in [T3| IB"]. 
For example, the above formula yields 

2 _ g 3 (l-g) 2 (l + g) 2 3 

H^ 1 )' 1 " (l-t)(l-qH) ^ i|P(2 ' 1 '°° 11 ~ q • 

Given our conjectured norm expression, it is natural to guess the form of the proper integral 
version of the Macdonald super polynomials: 

Conjecture 3. The monomial expansion coefficients of the following normalization of the Mac- 
donald superpolynomials 

J A =w A/ {t,q)P A . (4.18) 
are polynomial in q, t with integral coefficients (albeit not necessarily positive). 

This is a natural generalization of the integral form of the usual Macdonald polynomials 
[TU Eq. (VI. 8. 3)] and the (q, inversion of [5j Conj. 33]. The extension to superspace of the 
Macdonald positivity conjecture (see Conjectured]) will be given in terms of J A . 

Finally, we turn to the conjectured expression for the specialization. Let F(x; 9) be a polyno- 
mial in superspace of fermionic degree m and suppose that N > m. The evaluation of F(x; 9) 
is defined as 

~de m ---d ei F(x;9y 



E N , m [F(x;9)} :-- 

V m (x) 

where the specialization values u% are given by 



(4.19) 

xi=Ui,--- ,X N =U N 



and where 

V m {x)= ]J (Xi-Xj) (4.21) 
l<j<j'<m 
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is the Vandermonde determinant in the variables an, ... , x m . 

The following conjecture involves a combinatorial number £a that has no analogue for ordinary 
partitions. We consider the partial filling of the squares of A defined as follows: in each fermionic 
square of A write the number of bosonic squares above it; C\ is obtained by adding up these 
numbers. Here are three examples for which it is non-vanishing: 



C(l,0;2,2) 











2 


:) 



C(3,l,0;2) 



1 : 

















1 







D 



C(2,l,0;3,l) 









H 


1 




h- > 







(4.22) 



We also need to introduce, for A a superpartition of fermionic degree m, the skew diagram 
SA = A® /(5( m+1 ) j where 5^ is the staircase partition (m — 1, m — 2, . . . , 1, 0), and the quantity 
6(A) = — l)Aj, where A is a partition. Note that b(X/fi) will stand for 6(A) — b(/i). 

Conjecture 4. Let A be of fermionic degree m and suppose that N > £(A®). Then the evaluation 
formula for the Macdonald superpolynomials J\ defined in Conjecture [5] is: 

t CA t HSA) 



E N)m [J A (x,9;q,t)] 



J (m-l)|A a /5( m )|-fe(A a /5( m )) 



n 



i 



(j-l) f N-(i-l) 



(4.23) 



For m = 0, this reduces to the usual evaluation formula for the Macdonald polynomials [15^ 
Eq. (VI. 6. 11')], while for q = t a and t — > 1, it reduces to that of the Jack superpolynomials [6, 
Theo. 26]. 

To illustrate this formula, consider the evaluation of ■/(3 ) i i q ; i ) i)- Here m = 3 and we set N = 7, 
so that (xi, • • • ,x 7 ) = (q~ 2 , tq" 1 , t 2 , t 3 , i 4 , t 5 , t 6 ). We have 

(m - l)|A a /5 (m) | - b(A a /5 {m) ) = 2-1-0 = 2, b(SA) = 6(42111/321) = 11 - 4 = 7. (4.24) 
In the following product the contributing boxes are (1,4), (4, 1), (5, 1): 



(j-l) t N-(i-l) 



(l-g 3 i 7 )(l-t 4 )(l-^). 



n 

(M)6S(A) 

Finally, since C(3,l,0;i,i) = 0) we have 

E7, 3 [J(3,l,0;l,l)] = g~ 2 * 7 (l " * 3 )(1 " t 4 )(l ~ q 3 t 7 ). 



(4.25) 



(4.26) 



4.4. Limiting cases. We recall that for any superpartition A = (; A) of fermionic degree m = 0, 
the super polynomial P\(x,6;q,t) reduces to the standard Macdonald polynomial P\(x;q,t), 
whose distinct limiting cases |15| are summarized in Fig. [2j We now aim at generalizing this 
picture to superspace. 

The simplest cases are those directly related to the Jack polynomials. Indeed, as previously 
mentioned, with q = t a and t — > 1 in Pa(x,9; q,t) , the monic Jack superpolynomial pj^\x,9) 
is recovered. Moreover, it has been previously established [5] that P^\x,9) tends to m\(x,9) 

as a — > oo while it tends to (— 1)( 2 ^ex'{x, 9) as a — >• 0, where the elementary superpolynomials 
are defined as 

e\(x,0) = e A *(x,9) ■ ■ ■ eA^^x^) e\s(x) ■ ■ ■ e A s e (x), (4.27) 
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FIGURE 2. Classical limiting cases. The dotted arrows indicate limits not related to the Schur functions 




with 

e n (x, 9) = mr .in\(x, 9) and e n (x) = mi\n)(x) . (4.28) 
Similarly, for all tested Macdonald super polynomials, we found 

P A (x,6;q,l) = m A (x,6) and P A (x, 9; 1, t) = (-l)(?)e A '(a:, 9). (4.29) 

This means that each dotted limit of Fig. [2] has a simple generalization to superspace. 

Consider now the Hall-Littlewood limit. In the standard case, P\(x;t) is equal to P A (x;q,t) 
whenever q = 0, so it is natural to define the Hall-Littlewood superpolynomial as 

P A (x,9;t) = P A (x,9;0,t). (4.30) 

From Table we see that many super polynomials Pa simply reduce to m A when q = 0. This 
extreme simplicity is, however, an artifact of the smallness of the degree of these examples. 
Another noteworthy feature is that the scalar product (|4.9p is degenerate when q = 0. Conse- 
quently, our construction based on the extension of the reproducing kernel does not provide a 
natural scalar product for the P A (x,9;t)'s. In particular, their existence would not follow from 
a proof of the existence of the Macdonald polynomials in superspace. 

There is however another possible generalization of the Hall-Littlewood polynomial to su- 
perspace. Indeed, the standard Macdonald polynomials are invariant under the transforma- 
tion (q,t) i y (q ,t ), which implies that P\(x;t~ 1 ) = P\(x; oo,t). This suggests to define 
P A (x,9;t~ l ) = P A (x,9;oo,t), which is equivalent to defining 

P A (x,9;t) = P A (x,9;0,t), (4.31) 

where P A (x, 9; q, t) = P A (x, 9; q^ 1 ,^ 1 ). As could be expected from the non-symmetry in (|4.12|) . 
one gets (see Table [2]) that the families P A (x, 9; t) and P A (x, 9; t) are distinct. The advantage of 
the family Pa is that it inherits a scalar product from (|4,13p . 

Conjecture 5. The Hall-Littlewood superpolynomial P A {x, 9; t) = P A (x, 9; oo, t~ l ) is the unique 
superpolynomial satisfying 1) and 2) of Conjecture^ but with the second condition replaced by 

((Pn,P A f Ott = 0, Q^A. (4.32) 

where the scalar product is that given in (|4.13p when q = 0. 



12 



O. BLONDEAU-FOURNIER, P. DESROSIERS, L. LAPOINTE, AND P. MATHIEU 



It is tempting to conclude from the above conjecture that the appropriate Hall-Littlewood 
super polynomials should be the P\, but as we will see shortly, both families enjoy remarkable 
and somewhat entangled properties. A similar separation phenomenon occurs for the Schur 
super polynomials. We know from Fig. [2] that the standard Schur polynomial s\ can be seen 



either as the Hall-Littlewood polynomial P\(x; 0) or as the Jack polynomial P 



The gener- 



alization of the limiting cases to superspace is given in Fig. [3] and provides us with three possible 
Schur super polynomials that do not depend upon any extra parameter: 



s A {x,6) = P A Or, 0; 0,0), 



s{ ack (x,9) = P A (x,9;l,l), 



sa{x, 



Pa(x, 9; oo, oo) 



These super polynomials are respectively equal to the limits t — >• 0, t — >■ 1, t — > oo of 

s A {x,9;t) = P A {x,9;t,t). (4.33) 

We stress that when A = (;A) has fermionic degree m = 0, the latter reduces to P\(x;t,t), 
which is independent of t and equal to the standard Schur polynomial s\(x). According to 
Conjecture [TJ the one-parameter Schur polynomials s A (x,9;t) should be the unique triangular 
monic super polynomials that are also orthogonal with respect to the following scalar product: 



,]pn))t,t = (-!)(") «A-t |Aa| *A,n. 



(4.34) 



Note that the latter equation is well defined for all t ^ 0, oo. From a combinatorial point of 
view however, the positivity properties described below confirm that the cases t = 0, oo are the 
most interesting even though the scalar product is degenerate in those cases. 



FIGURE 3. Limiting cases in superspace 




s A (x,e) 



t->0 



p { A \x,l 



a— >1 



s^ ck (x 



t-tl 



s A (x,6;t) 



q— >oo 



P A {x,6;l/t) 



t— >oo 




s A {x,0) 



t— >oo 



4.5. A Macdonald positivity conjecture in superspace. As was just mentioned, by setting 
a = 1 in the Jack superpolynomial case, one obtains a candidate superspace version of the Schur 
polynomials^ However, these superpolynomials do not seem to have distinguished combinatorial 



We stress that these are completely different from the so-called supersymmetric Schur polynomials (see e.g., 
|21p which have no relation with anticommuting variables. For more details, see [4] Remark 14]. 
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properties such as positivity and integrality. This is neatly illustrated by the following example: 

s (i$3) =|™ i '(i,o;3)(a: 5 0;f,t) 

17 1 13 , 

= m (l,0;3) + 2 m ( 2 .0;2) + g m (l,0;2,l) + ^™(2,0;1,1) ~ g m (2,l;l) + | m (l,0;l,l,l)' ( 4 - 35 ) 

By contrast, the limits i — >• 0, oo depicted in Fig. [3] respectively lead to 

s (l,0;3) = m (l,0;3) + m (2,0;2) + m (l,0;2,l) + m (2,0;l,l) + m (l,0;l,l,l) ' ( 4 - 36 ) 
S(l,0;3) = m (l,0;3) + m (l,0;2,l) + m (l,0;l,l,l) ' ( 4 - 37 ) 

From the consideration of all the examples we could construct (cf . Table [T]) , we formulate the 
following conjecture. 

Conjecture 6. The expansion coefficients Kau and Kao. defined by 

s\ = Kaq, mn and s A = K A n m n (4.38) 

o<A n<A 

are non-negative integers. 

It is interesting and somewhat surprising to see that in superspace, the Schur polynomials with 
positive coefficients cannot be reached from the Jack side but solely from the Hall-Littlewood 
ones. Even more remarkably, it appears that the positivity of the change of basis matrix between 
the Schur and Hall-Littlewood polynomials generalizes to superspace. 

Conjecture 7. The expansion coefficients KAfi(t) and KAtt(t) defined by 

sa=Y1 ^An(*) Pn(t) and s A =Yl A AQ(t) Pn(l/t) (4.39) 

n<A n<\ 

are polynomials in t with nonnegative integer coefficients. Furthermore, when t = 1 they satisfy 
#An(l) = K A n and A' A q(1) = K A n- 

We end this section by presenting an outstanding conjecture that both supports the cor- 
rectness of our construction of the Macdonald superpolynomials and the related definitions of 
the Schur superpolynomials: the superspace version of the Macdonald positivity conjecture 
(see [2] or [15], eq VI (8.18?), and [12] for its proof). Introduce first the endomorphism <p of 
Q(q, t)[pi,P2,P3, ■ ■ ■ ',Po,Pi,P2, ■••], defined by its action on the power-sums a^l 

ip{p n ) = (1 - t n )p n and tp(pn) = p n . (4.40) 

We then introduce a deformation of the Schur superpolynomials sa{x, 6) as 

S A (x,9;t)= <p(s A (x,e)). (4.41) 

Conjecture 8. The coefficients KnA(q,t) in the expansion of the integral form of the Macdonald 
superpolynomials (see Conjecture^ 

J A (x,9;q,t) =J2 K ^A(q,t) S a (x,0;t) (4.42) 
n 

are polynomials in q and t with nonnegative integer coefficients (tables of coefficients Kn A (q,t) 
can be found at the end of the article). 



^This endomorphism corresponds in the non-fermionic case to the operation that sends f[X] to f[X(l — t)] in 
A-ring notation. This operation is called "plethysm" by some authors (see for instance Section 3.8 of [I]). 
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Although the Macdonald positivity conjecture in superspace is formulated in terms of the 
family of Schur superpolynomials sq, our computer calculations revealed that the generalized 
<?,i-Kostka coefficients K^(q,t) are related to the second family s A in a very elegant way. 

Conjecture 9. We have K nA = K nA (0, 1) and Kn\(t) = Kn\(0,t). 

5. Conclusion and outlook 

Since the discovery of the Jack superpolynomials [3], a natural question has been to determine 
their Macdonald counterpart. The obvious starting point was to look for the supersymmetric 
version of the trigonometric Ruijsenaars-Schneider model and define the Macdonald superpoly- 
nomials as the common eigenfunctions of all the conservation laws. However, no such candidate 
Hamiltonian has been found so far: this is still an open problem. We stress that to demon- 
strate the existence of the Macdonald superpolynomials it is almost imperative to determine the 
operators that have them as eigenfunctions. 

Under these circumstances, it is natural to proceed by brute force and investigate the existence 
of Macdonald polynomials in superspace constructed along a precise procedure (triangularity 
and orthogonality). This type of construction leads to over-determined systems of equations 
that only in a few remarkable cases have a solution. The experimental confirmation that the 
over-determined systems of equations we obtain have a solution (cf. Table [JJ gives strong 
evidence that we have defined the right Macdonald polynomials in superspace. We got further 
confirmation of the correctness of the characterization (|4.1ip by examining in Section 14.31 three 
other combinatorial properties, which happen to have the expected form generalizing what was 
obtained in the Jack superpolynomial case. 

In addition, we have identified (to be published elsewhere) the vanishing conditions generaliz- 
ing [TO] (see [9J in the Jack's case and [7] for the superspace version). The essential modification 
here is that the admissibility condition A, — Xk+i > r of [10] is changed to A® — A* +k > rjj 

The discovery of combinatorially richer versions of the Schur functions in superspace also open 
many avenues. For instance, new tableaux combinatorics should explain the monomial positivity 
of s\ and s\, and a connection with representation theory could hopefully be unraveled. 

But what appears to be the strongest validation of the present construction is clearly the su- 
perspace version of the Macdonald positivity conjecture. In a forthcoming publication, we will 
present other conjectures related to the q, t-Kostka coefficients in superspace, such as symmetry 
properties that generalize VI (8.14) and VI (8.15) of [T5] . One of those conjectures states explic- 
itly how the q, t-Kostka coefficients provide a non-trivial refinement of the q, i-Kostka coefficients 
(q, t-Kostka coefficients appear to be positive sums of q, i-Kostka coefficients in superspace). We 
can thus hope that the q, i-Kostka coefficients in superspace will help shed some light on the 
famously difficult combinatorics of the g,t-Kostka coefficients. 
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Quite interestingly, such admissible superpartitions for r — 2 describe the basis of states in the superconformal 
minimal models SM(2, 4k + 4) (see |17j.|lll Appendix] and the introduction of [7] for more details). 
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Table 2. Sample of small degree Macdonald polynomials in superspace ex- 
panded in the monomial basis (excluding those containing a single monomial 
term). 





Pa 


(i|i) 


^(i;) = m {1 . } + q [_J m (0; i) 


(2|1) 


^(lil) ="»(!;!) + m (0 ;l,l) 

n 1-t , (!+<?)(!-*) 

P(o-,2) = m (0i2 ) + !_ 9t m ( i;i) + m (0 ;i,i) 

) - ) + -(0; 2 ) + -d;D + fiSfjfe% ™(0;i,D 


(2|2) 


^(2,0;) = m (2,0;) + 9 }_, t ) m (li0;1) 


(3|2) 


D . (l+gt)(l-t) 

P (l,0;2) = ™(1,0;2) + l-gt 2 ^M;!,!) 

^(2,o ; i) - *n ( 2 >0 ;i) + 1_ gt } m ( i i0 ;2) + i ( _ gt ) m ( i >0 ;i,i) 

n> , 9(1-*) <3 2 t(l-<?)(l-*) , <3 2 (1-*) 2 

^(2,1;) = -(2,1;) + l- g i m (2,0;l) ( 1+ V)(l- g t) 2 TO (1,0;2) + (1 _ gt )4 -(1,0;1,1) 

P(3,0;) = -(3,0;) + -(2,i;0) + m (2 , 0;1) + ^ m (1 , 0;2) 


(4|1) 


^(1;1,1,1) = m (l;l,l,l) + l-gt* m (0;l, 1,1,1) 

7-) 1-t 3 , (l-t)(3<}t 2 +t 2 +2t+2qi+g+3) 

^(0;2,1,1) = m (0;2,l,l) + l-g t 3^(l;l,l,l) + i_ gt 3 — (0;1, 1,1,1) 

P ■ — m 1 q{1 ^- m 1 ( 1 - t )(*+ 2 9*+9+ 2 ) TT} 
^(1;2,1) - —(1:2,1) + l_ gt 2 TO ((>;2,1,1) 1 l_, t 2 — (1;1,1,1) 

, g (l-t 2 )(l-t)(3 9 t 2 +t 2 +2t+2< J it+g+3) m 
+ (i_ 9t 3 )(1 _ 9t 2 ) — (0;1,1,1,1) 

^(2;1,1) - m (2;l,l) + l- gt m U;2,l) 1 (l- q W)(l-qt) m (0;2,l,l) 

, 9(l-t)(3g 2 t 3 +gt 3 -g-3) . <r 2 (l-t) 2 (3< ? t 2 +t 2 +2t+2 9 t+< ? +3) 
+ (l- 9 2 t 3 )(l-gt) TO U;1,1,1) 1 (l- 9 2 t 3 )(1 _ 9t ) —(0;1, 1,1,1) 

r> 1-t i (l+o)(l-t) 
^(0;2,2) = -(0:2,2) + l_ gt -(l;2,l) + ,!} qt '-(0:2,1,1) 

(l-t) 2 (t+2gt+g+2) (l+ 9 )(l-t) 2 (t+2 9 t+g+2) 
+ (l-gt2)(l-ot) "W.M) 1 (l-gtS)(l-gt) m (0;l, 1,1,1) 
D . <? 2 (l-t 2 ) , (l+5)(l-t) . g(l+g)(l-t)(l- 9 t 2 ) 
f(2;2)=m(2;2) + , 1 i 9 2 t >(0 i 2,2)+ l ^ '-(2;1,1) + J) m (W) 

g 2 (l+q)(l-t)(l-t 2 ) g(l+,j)(l-t) 2 (t + 2 (? t+g+2) 
+ (l-g 2 t 2 )(l- 9 t) m i<J;2,l,ij 1 (l-qH*)(l-qt) TO (1;1,M) 

g 2 (l+ 9 )(l-t) 2 (l-t 2 )(t+2gt+g+2) 
+ (l-gt 2 )(l- 9 2 t 2 )(l- 9 t) — (0;1, 1,1,1) 

n> , (1+9)(1-*) i 1-t 2 i (1+<?)(1 — t)(l — g* 2 ) 
^(0;3,1) = m (0 ;3,l) + l- g t ;m (0;2,2) + !_ ? 2 t 2 -(2;1,1) + (il^/^j '-(1;2,1) 

(l-t)(-2g 2 t 2 -gt 2 -2 ( ( 3 t 2 - 9 t+ 9 2 t+2 9 + 9 2 +2)_ , (l+ 9 )(l-t) 2 (i+2 I jt+ ( 2+2) _ 
+ (l-g 2 t 2 )(l- 9 t) m l0;2,l,ij 1 (l-g 2 t 2 )(l-,jt) m (l;l,l,l) 

(l+<?)(l-t) 2 (3g 2 t+ 9 2 +2gt+2 9 +t+3) 
+ (l- 9 2 t 2 )(l-gt) -(0;1, 1,1,1) 
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Table 3. Kn\(q,t) for degree (1|1). 
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Table 4. KnA(q, t) for degree 


(2|1). 




(2;) 


(0;2) 


(i;i) 


(0;l,l) 


(2;) 
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i l 
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q" 


(0;2) 
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qt 
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(i;i) 
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qt 
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(0;l,l) 
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t 2 
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Table 5. K nA (q,t) for degree (2|2). 






(2,0; ) 


(1,0; 1) 




(2,0; ) 
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q 




(1,0; 1) 
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l 





Table 6. K nA (q,t) for degree (3|1). 





(3;) 


(0;3) 


(2;i) 


(i;2) 


(0;2,1) 


(i;M) 


(0; 1,1,1) 


(3;) 


l 


q" 


q + q 2 


q'+q* 


q 4 + q b 


q :i 


q b 


(0;3) 


t 


1 


qt + qH 


q + q 2 t 


q + q' 2 


qH 


q" 


(2;i) 


t 


qH 


l + qt 


q + q 2 t 


q 2 + qH 


q 


q* 


(i;2) 


t 2 


qt 


t + qt z 


1 + q 2 i 2 


q + q 2 t 


qt 


q 1 


(0;2,i) 


t A 


t 


t 2 + qt A 


t + qt 2 


l + qt 


qt 2 


q 


(i;i,i) 


t* 


qt A 


t + t 2 


t + qt 2 


qt + qt 2 


1 


q 


(0; 1,1,1) 


t b 


t A 


t 4 + t b 


t 2 +t A 


t + t 2 


t" 


l 



Table 7. K nA (q,t) for degree (3|2). 





(3,0; ) 


(2,1;) 


(2,0;1) 


(1,0; 2) 


(1,0; 1,1) 


(3,0; ) 


1 
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q + q 2 


q 2 


q" 


(2,1;) 


qt 


l 


q + q'H 


qH 


q 2 


(2,0;1) 


t 


t 


l + qt 


q 


q 


(1,0; 2) 


t 2 


qi A 


t + qt 2 


1 


qt 


(1,0; 1,1) 


t* 


t 2 


t + t 2 


t 


1 



